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[p3] Further, it may be desirable to monitor the state of the appliances and devices to 
provide diagnostics, services and maintenances. Some events may be caused by the 
internal changes within the appliances and devices. Some events may be caused by 
abnormal conditions such as paper jam in the copiers. Some error conditions and warning 
conditions may be caused by errors in the software installed in the target appliances and 
devices. 

[p4] Further, users are increasingly utilizing the Internet. There is significant interest in 
how users use the Internet, particularly with respect to how users may use certain web 
pages. Monitoring a user's usage of the Internet may also become significant. 

[p5] It may also be desirable to determine how a user is utilizing a certain application unit 
(e.g., a computer running a software application, a device with an interface to be operated 
by a user, or a web page). The user's usage of the application unit must be monitored and 
effectively communicated to a remote party. 

Field of the Invention 

[p6] This invention generally relates to a method and system that can monitor and 

communicate events using multiple protocols. Each of the plural protocols can be defined 
through the interface function. 

Brief Summary of the Invention 

[p7] One object of the present invention is to provide a novel and effective system for 
monitoring events of a target application of an application unit. 

[p8] A further object of the present invention is to provide a system for communicating 
data obtained by monitoring events of a target application of an application unit to a 
remote party. 
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[p9] 



A further object of the present invention is to provide a system for communicating 



data obtained by monitoring events of a target application of an application unit to a 
remote party allowing various data formats and communication protocols to facilitate the 
communication system configuration and received data analysis. 

[plO] A further object of the present invention is to provide a system for communicating 
data obtained by monitoring events of a target application of an application unit to a 
remote party allowing various data formats that ease the analyses of received data at the 
receiving side. 

[pi 1] A further object of the present invention is to efficiently communicate the monitored 
event information to a transmission unit. 

[pi 2] A further object of the present invention is to efficiently verify the combination of 
the two parameters specifying the format and protocol and to meet the restriction 
requirement on the second parameter. 

[pi 3] The present invention achieves these and other objects by monitoring the events of a 
target application of an application unit. Monitoring examples include (1) monitoring a 
software program being executed on a computer or workstation under control of a user, 
(2) monitoring usage of a control panel of an image forming apparatus (e.g., a copying 
machine, printer, facsimile, or scanner), an appliance (e.g., a microwave oven, VCR, 
digital camera, cellular phone, or palm top computer), (3) monitoring any internal state 
changes such as error conditions and warning conditions within appliances, devices and 
any systems and sending the results when requested or when events occur or when preset 
time interval occurs, (4) externally monitoring states of appliances, devices or system by 
polling at regular interval, and (5) generally monitoring any other device or service. The 
data obtained by monitoring events of a target application of an application unit, 
appliance, or device can, as a further feature in the present invention, be collected, logged 
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and communicated to a desired location by a store-and-forward protocol (e.g., Internet e- 
mail) or a "direct" connection protocol in which a socket connection is made to an 
ultimate destination machine (e.g., using FTP or HTTP). The use of store-and-forward 
communication reduces the costs associated with communicating such data. The data can 
be communicated to the desired location at several instances. Such instances include each 
time a user exits a target application, or after a predetermined number of times that a user 
has utilized and exited the target application of the application unit. If the configuration 
allows and if necessary, the direct connection between the monitored application and the 
monitoring system can be established in addition to the store-and-forward 
communication. 

Brief Description of the Several Views of the Drawings 

[pi 4] A more complete appreciation of the present invention and many of the attendant 
advantages thereof will be readily obtained as the same becomes better understood by 
reference to the following detailed description when considered in connection with the 
accompanying drawings, wherein: 

[pi 5] Figure 1 illustrates three networked business office machines connected to a network 
of computers and databases through the Internet; 

[pi 6] Figure 2 illustrates the components of a digital image forming apparatus; 

[pi 7] Figure 3 illustrates the electronic components of the digital image forming apparatus 
illustrated in Figure 2; 

[pi 8] Figure 4 illustrates details of the multi-port communication interface illustrated in 
Figure 3; 
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connected to the network; 

f„™« the flow of information to and from an 
m Figure 6A illusua.es in Hock dtagram format 

application unit using electronic mail; 

6B WusttaKS a » alternative way of communicating using electronic mail tn 

transfer agent; 

„ rnative way of communicating using electronic mail in 
m Figu re6Ci,.us, ra .esana..emat.vewy 

which an application unit includes a message transfer ag 

mail; 

wative way of communicating using electronic matl m 
w ^illustrates — ^^^^^ppliance^iceandas 
which a mail server acts as POP 3 server 
an SMTP server to send mail for Appliance/Device; 

wi used to communicate electronic mail messages; 
, „ Pi^^isahlc.kdiagramillustratingconnec^hetweenamonitoringand 

m jt*- ..— 

application unit in the present invention; 
can be applied; 
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m Figure 1 1 shows a second example of an application unit to which ,he present 

invention can be applied; 
[p2 9] Figure 12A shows the general architecture of the system; 

[p301 Figure 12B is an exemplary EventData class interface for use in the architecture of 

Figure 12 A; 

m Figure nCisanexemplaryFormanedEventDamclassinterfaceforuseinttte 

architecture of Figure 12 A; 
[P32, Figure 13 shows the calling sequence of the interface functions from application 

software within application unit, appliance or device; 
(P33, Figure 14 shows the processing when the Application software instructs DLL ,0 stop 
monitoring and send the monitored information with the specified forma.(s) using the 
specified protocol(s); 
[P34] Figure 15 shows the data structure used for intelligent formatting; 
W Figure 16A and 16B shows the source code tha, implements the processing shown in 
Figure 14; 

[P30] Figure 17 shows the data structure to handle the intelligent protocol processing with 

caching of the processing function; 
[p3 7] Figures ISAthrough 18D show a Processor Builder class according to one 

embodiment of the present invention; 
[P3S] Figure 19 shows the processing when the Application software instructs the system 



to use 



the specified format and protocol to transmit the monitored data; 
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u , ctmrture to keep track of the combination of format and 
[p39] Figure 20 shows the class structure to Keep ira^ 

protocols; 

W Figure 2. shows ,he processing of two parameters passed by ,he Application 

software through the System Manager computer code device; 
m] Figures 22 shows the processing to get a forma, parameters and associated iis, of 

protocols after checking the restriction on the protocol; 
[p42] Figures 23 A and 23B are class specification of CFormatProtoco. JnformationBase 
class that interface with the System Manager computer code dev.ce; 

Figures 24A and 24B are class specification 
class to verify the combination of format and protocol; and 

^ Figures 25A, 25B and 25C are Cass specification 

Cass where the steps in the oneFormatRestriction function shows the process to modtfy 

the map structure. 

Detailed Description of the Invention 

(p45] Referring now to the drawings, wherein like reference numera,s designate identica, 
orcorrespo„dingpa rt s to „ughoutmesevera,views,FigureH..us tt a,es( 1 ,vario„s 

machines and ^computers for monitorin, diagnosing and controlling me operatton of 

(LAN) connected to computer workstations ,7, 18, 20 and 22. The workstations can be 
wy type of computers including IBM Persona, Computer compatible devices, Umx- 
based computers, o, Apple Macintoshes. Also connected to the network ,6 are (1) a 
digital image forming apparatus 24, (2) a facsimile machine 28, and (3, a printer 32. As 
wouldbeapprectatedby one of ordinary skill intheart,.w„ or more of the components 
of the digitai image forming apparatus 24 and the facsimile machine 28 can be combmed 
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business office appliance. One exampie of such appliance ,s eCabinet from R,coh 
d e m „„s, ra teda tF aUC 0m de X in 1 9,9a t UsVe g as. Also, a facsimiie server no, 

forming apparatus 24, facs.mile machine 28, and printer 32 heing connected ,0 the 
ca b,e and,or »ire,ess connections 26, 30 and 34, respective., As is exp.arned heiow he 

a — device, throughthe interne, via the netwo* >6 or hy a direct teiephone, 
ISDN, wireless, or cable connection. 
Io461 ln Fi g u,e 1 ,awidea,eane,wo* ( WAN)(e. g .,.heInteme,ori,ssuccess„r)i S 

„ , • ,ed bv .0 The WAN 10 can either be a priva.e WAN, a pubiie WAN or 

generally designated by 1U. me wain 

ahy brid.TheWAN lOincludes a plurality of i„,erconnec,ed compters and r„u,ers 

w ■ ^hv HTTP// www.ietf.org/rfc.html, including RFC 8/1 
series of RFC documents obtained by HI 1 r//.www. * 

f d t ^oi»- RFC 822 entitled "Standard for the Format ot 
entitled "Simple Mail Transfer Protocol , RFC 

ARPA internet Text Message" ; RFC 959 entitled "File Transfer Protocol (FTP) , RFC 
20 45 entitled "Multipurpose Internet Mail Extensions (MIME) Part One: Format of 

n h w RFC 1894 entitled "An Extensible Message Format for 
Internet Message Bodies , RFC 18^ emu 

Deiivery Status Notifications"; RFC .939 entitled "Post Office protocol - Versron ; 
mi RFC 2298 entitled "An Extensible Message Forma, for Message Dispos.Uon 
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Notifications." The contents of each of those references are incorporated herein by 

reference. 

lp47] TCP/IP related communication is described, for example, in the book "TCP/IP 
,„ustra,ed,» Vol. 1. Tne Protocols, by W.R. Stevens, from Addison-Wesley Publishing 
Company, 1994, which is incorporated herein by reference. Volumes 1-3 of 
•internetworking with TCP/IP" by Comer and Stevens are also rncorporated herem by 
reference in their entirety. 
W In Figure ,. a firewall 50A is connected between the WAN 10 and the network 16. A 
firewall is a device that a,,oWs only authorized computers on one side of the firewall to 
access a network, computers or individual parts on the other side of the firewall. Firewalls 
„ known and commercially availaMe devices and/or software (e.g., SunScreen from Sun 
Microsystems ,nc). Similarly, firewalls SOB and 50C separate the WAN 
network 52 and a workstation 42, respectively. Additional details on firewalls can be 
found in "Firewalls and Internet Security" by W. R. Cheswick, and S. M. Bellovin, 1994, 
Addison-Wesley Publishing, and "Building Internet FirewaUs" by D. B. Chapman and E. 
D. Zwicky, 1995, O'Reilly ft Associates, Inc. The contents of those references are 
incorporated herein by reference. 
|p49] The network 52 is a conventional network and includes a plurality 

56 62 68 and 74. These workstations may be in different departments (e.g., marketing, 
manufacturing, design engineering and customer service departments) within a smgle 
company. In addition to the workstations connected via the network 52, ftere ,s a 
workstation 42, which is not directly connected to the network 52. Information in a 
database stored in a disk 46 may be shared using proper encryption and protocols over the 
WAN .0 to me workstations connected directly to the network 52. Also, the workstation 
42 includes a direct connection to a telephone fine and/or ISDN and/or cable and/or 
™ re ,ess network 44 and the database in disk 46 may be accessed through the telephone 
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, ine ,SDN, cab,e o, wirelessly. The cabie used by this invention may be implemented 
using a cable which typicaliy is used ,0 carry tension programming, a cable whrch 

• ~f a\ „\t»\ data tvoically used with computers or 
provides for high speed communication of digital data typically 

the like, or any other desired type of cable. 
.50, .nformation of the business office machines, business devices or business office 

app,iances 2 4,28and32may be stored in one or more of the databases stored inthedisks 
46 54 58 64, 70 and 76. Known databases include (1) SQL databases by Microsoft, 
Oracie and Sybase (2) other relational databases, and (3) non-relational databases 
(including object oriented databases). Each of the customer service, marketmg, 
manufacturing, and engineering departments may have their own database or may share 
one or more database, Each of the disks used to store databases is a non-volatiie memory 
SU eh as a hard disk or optic*, disk. Alternatively, the databases may be stored m any 
storage device including solid state and/or semiconductor memory devices. As an 
example, disk 64 contains the marketing database, disk 5S contains the manufactunng 
. database, disk 70 contains the engineering database and disk 76 contains the customer 
service database. Alternatively, the disks 54 and 46 store one or more of the databases. 
[p5 „ ,„ addition to the workstations 56, 62, 68, 74 and 42 being connected to the WAN, 
th ese workstations may also include a connection to a telephone line, ISDN, cable, or 
wireless network which provides a secure connection to the machine being monttored, 
diagnosed and/or controUed and is used during communication. Addition*, if one 
communication medium is not operating properly, one of the others can be automahcally 
used for communication. 
, p521 A feature of the present invention is the use of a -store-and-forward" mode of 

for diagnosing and controlhng the machine. Alternatively, the message wh.cn ,s 
emitted may be implemented using a mode of communication ma, makes direct, end- 
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• , e . ustog a S o*e.co ffl .=c.ion.o«heuHima.edesUna, i o„). 
to-end connections (e.g., using a 

f( . j: oita i image forming apparatus 24 

1 in Figure 2 101 is a fan for the scannc , 
iUus.ra.ed m F.gure 1 . 1. Figure ^ a ^ 

^ 1 frt designates an r lens useu iu v 
used with a laser printer, and 103 designa ^ ^ 

1 1 r>4 designates a sensor tor aeienmg & 
(„„, il,us<ra,ed). Reference numeral 104 des.gr. wil 
, 05 is a lens for focusing light from scanner onto *e sens 

ed.ocraseirnagesonm.p- ctive drum 132. There ts a 
quenching lamp used .0 erase .mg 109 designates 

chMging c„ronauniU07a n dadcve,opin 8 ro,lcrO^ 

.^used.oiilus.ra.eadocumcnt.ohcscanne^ ^ ^ mirror, ,3 used to 
— — t-H-* char.ngareaofd.ed,,, 

•^^"irl amllfeed^ — USisasecond 

fl.ef.rs.papercasscnem.an 120 debates a re,ay 

caper feed roller for the second cassette 119. Rcter 

P u ,79 k an image density sensor and 123 is a 

^Ulisare^onroller.Uitsantm 25isa 

o „nit Reference numeral 124 is a cieanu g 
-sfer/separationeoronaum l »* ^.^..d. 

exhaus. fan and 1 31 is the ma.n mo.or used 

„f .he electronic components illustrated in 

Fig u,e2.T h eCPU160isamicroprocessor,da- „ opetatinB 

n*OM> 164 or a Flash Memory) stores (1) the prog 
only memory (ROM) ^ copier ( , g ., the 

digital image forming apparatus and (2) static 
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model number, serial number of the copier, and defaul, parameters. 
(p55] There is a muM-por, network interface ,66 which allows the digital image forming 
apparatus to communicate with externa, devices through a, least one network. Reference 
number ,68 represents a telephone, ,SDN, or cable line, and numeral ,70 represents 
another type of network. Addition, detaiis of the mu„i-port network interface are 

operation pane, ,74 to a system bus ,86. The operation pane, ,74 inc.udes standard input 
and output devices found on a digita, image forming apparatus induding a copy button, 
keys to control the operation of the copier such as number of copies, 
re duceme„t/e„,argemen,, darkness/lightness, etc. Additionally, a ,i,uid crystal display 
may be induded within the operation pane, 174 to display parameters and messages of 
the digital image forming apparatus to a user. 

• • + f, A i 7 i connection through local ports such as 
r D 561 The local connection interface 171 is a connecuon s 

- RS232 the parallel printer port, USB, and IEEE 1394. FireWire (IEEE 1394) is described 

in Wickelgren, ,., "The Facts About "FireWire", ,EEE Spectrum, April 1997, Vol. 34, 

Number 4, pp. 19-25, the contents of which are incorporated herein by reference. 

Preferably, communication utilizes a -reliable" protoco, with error detection and 

retransmission. 

[05,, A storage interface ,76 connects storage devices ,„ the system bus ,86. The storage 
devices indude a flash memory 1 78 which can be substituted by a conventvona, 
EEPROM and a disk , 82. The disk ,82 inCudes a hard disk, optica, disk, and/or a floppy 
disk drive. There is a connection ,80 connected to the storage interface ,76 which allows 
for additional memory devices to be connected to the dtgital image forming apparatus. 
The flash memory 178 is used to store semi-static state data which describes parameters 
of the digit.! image forming apparatus which infrequently change over the hft of the 
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copier. Such parameters include the options and configuration of the digital image 
forming apparatus. An option interface 184 allows additional hardware such as an 
external interface to be connected to the digital image forming apparatus. A clock/timer 
187 is utilized to keep track of both the time and date and also to measure elapsed time. 

[p58] On the left side of Figure 3, the various sections making up the digital image 

forming device are illustrated. Reference numeral 202 designates a sorter and contains 
sensors and actuators used to sort the output of the digital image forming device. There is 
a duplexer 200 which allows a duplex operation to be performed by the digital image 
forming device and includes conventional sensors and actuators. The digital image 
forming device includes a large capacity tray unit 198 which allows paper trays holding a 
large number of sheets to be used with the digital image forming device. The large 
capacity tray unit 198 includes conventional sensors and actuators. 

[p59] A paper feed controller 196 is used to control the operation of feeding paper into and 
through the digital image forming device. A scanner 194 is used to scan images into the 
digital image forming device and includes conventional scanning elements such as a 
light, mirror, etc. Additionally, scanner sensors are used such as a home position sensor to 
determine that the scanner is in the home position, and a lamp thermistor is used to ensure 
proper operation of the scanning lamp. There is a printer/imager 192 which prints the 
output of the digital image forming device and includes a conventional laser printing 
mechanism, a toner sensor, and an image density sensor. The fuser 190 is used to fuse the 
toner onto the page using a high temperature roller and includes an exit sensor, a 
thermistor to assure that the fuser 190 is not overheating, and an oil sensor. Additionally, 
there is an optional unit interface 188 used to connect to optional elements of the digital 
image forming device such as an automatic document feeder, a different type of 
sorter/collator, or other elements which can be added to the digital image forming device. 
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FlgU re 4 inus.ra.es details of the multi-port network in.erface .66. The digha, image 
forming device may _ica,e «o ex.er„al devices mrough a Token tog interface 
220 a cable modem unit 222 which has a high speed connection over cable, a 
c„„ve„.iona, .Cephone interface 224 wh,ch com.cc, .o a .ciephone line 168A, an .SDN 
interface 226 which connect .0 an ISDN line .688, wireless interface 228, and a LAN 
interface 230 (e.g., Ethernet) which connects to a LAN .70. Oher interfaces (no, show.) 
include, bu. are not limited ,0, DigUal Subscriber Line (DSL) (origina, DSL, concede 
DSL and asymmetfc DSL). A sing.e device which conncc,s .o bom a Local Area 
Network and a telephone ..ne is commercial avai,ab,e from Megahertz and is known as 
the Ethernet-Modem. 

,„ The CPU or other microprocessor or circuitry executes a monitoring process to 
mo „i.or the s.a.e of each of .he sensors of .he dighal image forming device, and a 
seauencing process is used to execute .he instructions of the code used .0 c„n.ro. and 
operate the digha. image forming device. Additionally, there is (., a centra, sy,em 
con*,, process execu.ed ,o co„.ro. fhe overal, opera.io» of the digital image formmg 
device and (2) a communica.io» process used .o assure reliable communication to 
externa, devices connected to .he digha. image forming device. The sysfem con.ro. 
ptocess monitor, and con.ro.s da. s,orage in a static state memory (e.g., the ROM ,64 of 
Pigure 3), a semi-s«a.ic memory (e.g., »e flash memory ,78 or disk ,82), or me dynamic 
state memory (e.g., a vo.,ilc or non-vo,a.i,e memory (e.g., me RAM ,62 or .he flash 
memory ,78 or disk ,82)). Addi.iona„y, me s.a,ic state memory may be a dev.ee other 
man .he ROM ,64 such as a non-vo,ati,e memory inciuding enher of the flash memory 
178 or disk 182. 
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(e.g., a microwave oven, VCR, dig „ esofdevices which operate using 

, direct connection-based commumcawn. Such 

store -and.forward or dtrec, ^ 

* n Grinding eas, water, or eiecui^ 
metering systems (— 8 automobi ,es) that need to be monitored 

machines, or any other meehantcal dev.ce (e.g., 

• in dHrKtion to monitoring special ^ y 

the invention in which different 

Figure 5. In Figure 5, there or ^ 

. • e 254 connected to the intranet 260-1 mciuoe 
The service machine 254 conn ^ ^ 

— -^"^""r^lcemachtne^maybe 

• t of devices which are being monitored. The servic 
equipment of devices wrm. monitored devices to transmit 

^reddevices.Theservieemachine.MmaybennpiementedasanytyP 
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and is preferably implemented using a computerized device such as a general purpose 

computer. 

[p64 ] Another sub-system of Figure 5 includes a firewall 50-2, an intranet 260-2, and a 
printer 262 connected thereto. In this sub-system, the functions of sending and rece.vtng 
electronic messages by the printer 262 (and similarly by a copier 286) are performed by 
(,) circuitry, (2) a microprocessor, or (3) any other type of hardware contained w,th,n or 
mounted to the printer 262 (i.e., without using a separate general purpose computer). 
[P65, An alternate type of sub-system includes the use of an Interne, service provider 264 
which may be any type of Internet service provider (ISP), including known commerctal 
companies such as America Online, Earthlink, and Niftyserve. In this sub-system, a 
computer 266 is connected to the ISP 264 through a digital or analog modem (e.g., a 
telephone line modem, a cable modem, modems which use any type of wires such as 
modems used over an ISDN (Integrated Services Digital Network) line, ASDL 
(Asymmetric Digital Subscriber Line), modems which use frame relay communication, 
wireless modems such as a radio frequency modem, a fiber optic modem, or a device 
which uses infrared hgh, waves). Further, a business office device 268 is connected to the 
computer 266. As an alternative to the business office device 268 (and any other dev.ce 
ihustrated in Figure 5), a different type of machine may be monitored or con.roi.ed such 
as a digital copier, any type of appliance, security system, or utility meter such as an 
electrical, water, or gas utility meter, or any other device discussed herein. 

lp66] Also illustrated in Figure 5 is a firewall 50-3 connected to a network 274. The 

network 274 may be implemented as any type of computer network, (e.g., an Ethernet or 
token-ring network). Networking software which may be used to control tine network 
includes any desired networking software including software commercially available 
from Novell or Microsoft. The network 274 may be implemented as an Intranet, if 
desired. A computer 272 connected ,„ me network 274 may be used to obtain information 
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from a business office device 278 and generate reports such as reports showing problems 
which occurred in various machines connected to the network and a monthly usage report 
of the devices connected to the network 274. In this embodiment, a computer 276 is 
connected between the business office device 278 and the network 274. This computer 
receives communications from the network and forwards the appropriate commands or 
data or any other information, to the business office device 278. Communication 
between me business office device 278 and the computer 276 may be accomplished using 
wire-based or wireless methods including, bu, no. limited ,0 radio frequency connections, 
electrical connections and light connections (e.g., an infrared connection, or a fiber opttcs 
correction). Similarly, each of the various networks and intranets illustrated in Figure 5 
may be established using any desired manner including through the establishment of 
wireless networks such as radio frequency networks. The wireless communication 
described herein may be established using spread spectrum techniques including 
techniques which use a spreading code and frequency hopping techniques such as the 
frequency hopping wireless technique which is disclosed in the Bluetooth Specification 
(available at the world wide web site www.blue.ooth.com), which is incorporated herem 
by reference. 

[P07, An„.her sub-system il.us.ra.ed in Figure 5 includes a firewall 50-4, an intranet 260- 
.4, a computer 282 connected thereto, a business office appliance 285 and a copier 286. 
The computer 282 may be used to generate reports and request diagnostic or control 
procedures. These diagnostic and control procedures may.be performed with respect to 
.he business office appliance 285 and the copier 286 or any of the other devices iuus.ra.ed 
in or used with Figure 5. While Figure 5 illustrates a plurality of firewalls, the firewalls 
are preferable but optional equipment and therefore the invention may be operated 
without the use of firewalls, if desired. 
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o ■ /Wianc 300 connected to a typical e-mail exchange 

which may be implemented m a conve 

, m : n+pr faces with any of the application unn 

described herein. While Mgu Further more, if 

desired, the user may not be neede Popular m ail agents for Unix 

• f .in? then interacts with a mail agent ju^.r v 
computer interface 302 then of 

requ esto f *eco m p UK n»,c rf ace30 it „ent 8 ^^^^^ 

^ tn » Messaae Transfer Agent (MTA) 308. A comm 
is forwarded to a Message exchange 

* , iTvnicallv the message transfer agents 308 and 
systems is Sendmail. Typically, t communlca tion between the 

TrPAP connection. Notably, tne conm 
communications usmg a TCP/IP conn ^ 

♦ ,08 and 312 may occur over any size network (e.g , 
me ssage transfer agents 308 and y commun ication 
LAN) .Further,themessagetransferagents308and312 he 

+ e and 304 reside in the library iu 
protocol, in the present invcntton, steps 302 and 

application unit's usage. 

,«312 e-mail messages are stored in user mailboxes 

W» — Cn ; 312 ; l dult , mat e, y — e dtotheuserata 

3 ,4 which arc transferred to the mat. agent 3 16 and 
terminal 3 18 which functions as a receiving terminal. 

the application would be unrespons.ve. Such an unr 
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ceptable to users of .he application unit By using e-mail as the store-and-forward 
process, retransmission attempts after failures occur automatically for a fixed period of 
time (eg., three days). In an alternate embodiment, the application can avoid waiting by 
passing communicating requests to one or more separate threads. Those threads can then 
control communication with the receiving termina. 3)8 while the application begins 
responding to the user interface again. In yet another embodiment in which a user wishes 
to have communication completed before continuing, direct communication with the 
receiving terminal is used. Such direct communication can utilize any protocol not 
blocked by a firewall between the sending and receiving terminal, Examples of such 
protocols include FTP and HTTP. 
[ P 71] Public WANs, such as the Internet, are not considered to be secure. Therefore, 

messages transmitted over the public WANs (and multi-company private WANs) should 
be encrypted ,0 keep the messages confidential. Encryption mechanisms are kno™ and 
commercial available which may be used with the present invention. For example, a C 
library function, crypto, is available from Sun Microsystems for use with the Unix 
operating system. Other encryption and decryption software packages are known and 
commercially available and may also be used with this invention. One such package is 
PGP Virtual Private Network (VPN) available from Network Associates. Other VPN 
software is available from Microsoft Corporation. 
[p721 As an alternative to the general structure of Figure 6A, a single computer may be 
used which functions as the computer interface 302, the mail agent 304, the mail queue 
306 and the message transfer agent 308. As illustrated in Figure 6B, the 
Device/Appliance 300 is connected to a computer 301 which includes the message 
transfer agent 308. 
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[p73] A further alternative structure is shown in Figure 6C in which the message transfer 
agent 308 is formed as part of the Device/Appliance 300. Further, the message transfer 
agent 308 is connected to the message transfer agent 312 by a TCP/IP connection 310. In 
the embodiment of Figure 6C, the Device/Appliance 300 is directly connected to the 
TCP/IP connection 310 and has an e-mail capability. One use of the embodiment of 
Figure 6C includes using a facsimile machine with an e-mail capability (defined in RFC 
2305 (a simple mode of facsimile using Internet mail)) as the Device/Appliance 300. 

[p74] Figure 6D shows a system where an appliance or a device does not itself have the 
capability to receive directly e-mail, but uses the POP3 protocol to retrieve the received 
mail from mail server. 

[p75] Figure 7 illustrates an alternative implementation of transferring mail and is based 
on Figure 28.3 of Stevens. Figure 7 illustrates an electronic mail system having a relay 
system at each end. The arrangement of Figure 7 allows one system at an organization to 
act as a mail hub. In Figure 7, there are four MTAs connected between the two mail 
agents 304 and 3 1 6. These MTAs include local MTA 322A, relay MTA 328A, relay 
MTA 328B, and local MTA 322D. The most common protocol used for mail messages is 
SMTP (Simple Mail Transfer Protocol) which may be used with this invention, although 
any desired mail protocol may be utilized. In Figure 7, 320 designates a sending host 
which includes the computer interface 302, the mail agent 304, and the local MTA 322A. 
The Device/Appliance 300 is connected to, or alternatively included within, the sending 
host 320. As another case, the Device/Appliance 300 and host 320 can be in one machine 
where the host capability is built into the Device/Appliance 300. Other local MTAs 322B, 
322C, 322E and 322F may also be included. Mail to be transmitted and received may be 
queued in a queue of mail 306B of the relay MTA 328A. The messages are transferred 
across the TCP/IP connection 310 (e.g., an Internet connection or a connection across any 
other type of network). 
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[p76] The transmitted messages are received by the relay MTA 328B and if desired, stored 
in a queue of mail 306C. The mail is then forwarded to the local MTA 322D of a 
receiving host 342. The mail may be placed in one or more of the user mailboxes 314 and 
subsequently forwarded to the mail agent 3 1.6 and finally forwarded to the user at a 
terminal 318. If desired, the mail may be directly forwarded to the terminal without user 
interaction. 

[p77] The various computers utilized by the present invention, including the computers 
266 and 276 of Figure 5, may be implemented as illustrated in Figure 8. Further, any 
other computer utilized by this invention may be implemented in a similar manner to the 
computer illustrated in Figure 8, if desired, including the service machine 254, computer 
272, and computer 282 of Figure 5. However, not every element illustrated in Figure 8 is 
required in each of those computers. In Figure 8, the computer 360 includes a CPU 362 
which may be implemented as any type of processor including commercially available 
microprocessors from companies such as Intel, AMD, Motorola, Hitachi and NEC. There 
is a working memory such as a RAM 364, and a wireless interface 366 which 
communicates with a wireless device 368. The communication between the interface 366 
and device 368 may use any wireless medium (e.g., radio waves or light waves). The 
radio waves may be implemented using a spread spectrum technique such as Code 
Division Multiple Access (CDA) communication or using a frequency hopping technique 
such as that disclosed in the Bluetooth specification. 

[p78] There is a ROM 370 and a flash memory 371, although any other type of non- 
volatile memory (e.g., EPROM, or an EEPROM) may be utilized in addition to or in 
place of the flash memory 371 . An input controller 372 has connected thereto a keyboard 
374 and a mouse 376. There is a serial interface 378 connected to a serial device 380. 
Additionally, a parallel interface 382 is connected to a parallel device 384, a universal 
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serial bus interface 386 is connected to a universal serial bus device 388, and also there is 
an IEEE 1394 device 400, commonly referred to as a fire wire device, connected to an 
IEEE 1394 interface 398. The various elements of the computer 360 are connected by a 
system bus 390. A disk controller 396 is connected to a floppy disk drive 394 and a hard 
disk drive 392. A communication controller 400 allows the computer 360 to 
communicate with other computers (e.g., by sending e-mail messages) over a telephone 
line 402 or a network 404. An I/O (Input/Output) controller 408 is connected to a printer 
410 and a hard disk 412, for example using a SCSI (Small Computer System Interface) 
bus. There is also a display controller 416 connected to a CRT (Cathode Ray Tube) 414, 
although any other type of display may be used including a liquid crystal display, a light 
emitting diode display, a plasma display, etc. 

| One feature in the present invention is to monitor how a user uses a target 
application of an application unit. The term application unit in this instance refers to a 
system which a user interacts with and controls. A "target application" refers to a user 
controlled system that controls the application unit. For example, an application unit may 
typically be a computer and a target application may then be a software program, e.g. a 
word processor, running on the computer which a user operates, for example by moving a 
pointer on a computer screen and "clicking" on certain command icons to cause the 
software program to perform certain functions. In this sense, an application unit in the 
present invention can refer to any of workstations 17, 18, 20, 22, 56, 62, 68, 74, 42 shown 
in Figure 1 running a software program, the computer 301 shown in Figure 6B running a 
software program, etc. An application unit can also refer to an image forming device such 
as any of the digital image forming apparatus 24, facsimile machine 28, and printer 32 in 
Figures 1 and 2. In this instance, each of these device application units includes a user 
interface, such as operation panel 174 (see Fig. 3), which a user interacts with and utilizes 
to control the device application unit. The present invention can monitor a user selecting 
controls on such an operation panel. As a further example, the application unit could also 



Page 24 of 78 




be an appliance, such as a microwave oven, with an operation panel. An application unit 
can also refer to any other device, including software, with which a user interacts, and in 
this case the target application may refer to only one feature of the software which the 
user interacts with. 

[p80] One feature of the present invention is to monitor the user's usage of such a target 
application of an application unit, and to communicate data of the monitored usage. This 
data will typically be transmitted by e-mail by the computer interface 302 of Figure 6A, 
or the computer 301 of Figure 6B or the Device/Appliance 300 of Figure 6C. This data of 
a user's usage of a target application of an application unit can then be utilized in many 
ways, for example in improving software development, in monitoring usage of a device 
(e.g., an image forming device), discovering user difficulties with appliances and 
software, and finding most frequently used features of application units. 

[ P 8 1 ] Figure 9 shows various elements of the present invention. More particularly, Figure 
9 shows an Device/Appliance 300 including target applications 5 1 0, 512 and 513. The 
user interface 510 is an interface for a user to control the appliance or device. As 
discussed above, in one common instance, the target appliance 300 may be a software 
program running on one of the workstations 17, 18, 20, 22 (Figure 1) of the present 
specification. In this instance, the user interface 510 may be a display on a monitor of one 
of these workstations. In such a case, the monitoring system 515 may monitor the user 
behavior of clicking the selected menu. Another application may be that the appliance 
300 is a copier where "application 2" (512) is a sorting of the multiple copies. Both User 
interface 5*10 and "Application 2" (512) would send event messages to Monitoring 
System 515 to be logged. The Monitoring System 515 is implemented either only in 
hardware or using a combination of hardware and software where the combination 
includes at least one computer readable medium. Examples of computer readable media 
are compact discs 119, hard disks 112, floppy disks, tape, magneto-optical disks, PROMs 



Page 25 of 78 



(EPROM, EEPROM, Flash EPROM), DRAM, SRAM, SDRAM, etc. Stored on any one 
or on a combination of computer readable media, the present invention includes software 
for controlling both the hardware and for enabling the system to interact with a human 
user. Such software (in the form of computer code devices) may include, but is not 
• limited to, device drivers, operating systems and user applications, such as development 
tools. Such computer readable media further includes the computer program product of 
the present invention for monitoring and controlling an application unit. The computer 
code devices of the present invention can be any interpreted or executable code 
mechanism, including but not limited to scripts, interpreters, dynamic link libraries, 
classes (e.g., Java or C++), packages (e.g., Java or C++) and complete executable 
programs. 

[p82] Another illustrative embodiment of Figure 9 is an office device such as a digital 
copier where Application 1 (510) is the aforementioned user interface. Application 2 
(512) is the software error tracking system to monitor the internal error conditions of the 
software system. Application 3 (513) is the mechanical error tracking system to monitor 
the mechanical error condition such as jam and toner out. All of the applications are using 
the Monitoring System (515) and Sending Block (520). As a further example, and as 
noted above, the Device/Appliance 300 may be an image forming device such as the 
digital image forming apparatus 26, facsimile machine 28, or printer 32 also shown in 
Figure 1 . In this instance, the user interface 510 may take the form of an operation panel 
(e.g., operation panel 174 in Fig. 3) with a plurality of keys and/or a touch screen which a 
user operates to control the image forming device. When the Device/Appliance 300 in 
Figure 9 is an image forming device with a user interface 510, the present invention can 
monitor the commands that a user selects. 
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[p83] At a designated time, the logged data of the events is then sent to the sending block 
520, which then communicates such monitored event data to a designated party. The 
monitoring and logging DLL 515 can be implemented in the device including the 
Device/Appliance 300 or in another system control element. The protocol processing 
system can also be implemented in the device including the application unit in Figure 6C, 
or can also be implemented in the computer 301 in Fig. 6B to which the application unit 
is attached. The present invention can also take the form of computer control codes 
recorded on a computer readable medium. 

[p84] One illustrative embodiment of such a user interface 510 used with a digital image 
forming apparatus 26, facsimile machine 28, or printer 32 is shown in Figure 1 1. In that 
embodiment, the present invention monitors each time a user presses one of the control 
buttons on the operation panel and logs the usage data of such a user usage for subsequent 
communication. 

[p85] As shown in Figure 1 1 , such an operation panel 700 may include a touch screen 705 
on which various commands may appear which an operator can select by touching 
different portions of the touch screen 705. The operation panel 700 may also include a 
10-key pad 710 and various other control buttons 715. In the case of an image forming 
device, the control buttons 715 may be commands for selecting a paper size, changing a 
magnification, changing a darkness of a desired image, etc. 

[p86] When the Device/Appliance 300 in Figure 9 is an image forming device and the user 
interface 510 corresponds to the operation panel 700 as shown in Figure 1 1, the present 
invention can monitor the commands (shown in Figure 1 1) that a user selects. The 
operation panel 700 shown in Figure 1 1 may, with modifications, also be an operation 
panel for a user-controlled appliance such as a microwave oven, VCR, digital camera, 
cellular phone, palm top computer, etc. 
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[p87] Figures 1 0 and 1 1 show examples of the Device/Appliance 300 and user interface 
510 of Figure 9 to which the present invention can be applied. As would be readily 
apparent to those of ordinary skill in the art, the present invention is directed to various 
types of application units including various types of user interfaces. The present invention 
is applicable to any device to be monitored which includes a user interface. 

[p88] Figure 1 2 shows the general event management architecture of the system that can 
be implemented as any one, or a combination of, a dynamic linked library (DLL), a 
script, a Java or C++ class, a C library or routine, etc. The remainder of this discussion 
describes the implementation in terms of a DLL. In general, an application 510 
communicates through an interface 550. The interface 550 specifies the API for the event 
management architecture (e.g., how information is passed via a C function call to the 
object(s) in the System Manager 560 with the same names). The System Manager 
computer code device 560 manages the behavior of other computer code devices by using 
appropriate objects and their functions. Similarly, the Event Logger 565 records all the 
necessary information such as User ID, Application ID, Cumulative Session Number, 
Start Time, Duration and Sequence of Events with the elapsed times when requested 
through the system manager 560. The Event Logger supports functions including: 
initialize(), storeEvent (), stopMonitoring(), and getEventData(). 

[p89] The initialize function receives a string parameter for the Application ID. The 

System Manager 560 calls this function when startMonitoring is called by an application 
510. The function sets the Application ID, takes care of the Cumulative number of 
usages, reads the clock to store the start time in order to compute the elapse time and 
duration, and sets up the user information by examining the registry. 
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, m The initialize function receives a string parameter for the App.ica.ion ID. The 
5,0 The function sets the Application ID, takes care of the Cumulative number of 

duration, and sets up the user information by examining the regtstry. 

r p91] After the application 510 has completed its usage monitoring, it calls the 

stopMonitoring^tionsothatthedr.a.ioncanbecomputed.Ifmultiplcsessionsare 

stored, this function stops the recording of a corresponding sess.cn. 

m] After initia.iza.ion, the s,oreEven<() function can be called with a string parameter 
f 0 rtheEventpassedb y rec„rd E ven,.TheEven, L ogger565s,ores,heeven,s„inga„d«he 

elapsed time from the star, time (recorded during .he initialize*) ft.nc.ion ca..,. 

The Eve„.Logger 565 also provides access .o a ge.Even.Da. function. If the 

undefined), me monitoring is stopped by calling the stopMoni.oring function. The 

abstract class facilitates extensions for multiple.sessions. 
[p94] The Form, And Protocol .nformation Base System 570 (imp,emen«ed as any one or 
a combinafion of package, DLL, s«a.,c library, c.c, stores the forma, and protocol 
information and checks .he combinaUon of forma«s and protocols .o determine the vahd 
combinations. To faclitate me storage process, the storeEormatAndProtoco. function 

^^^^^^^^^^^ 

ensure ma. me parameters are a valid combination. 
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[p95] The component 570 also includes a getFormatAndProtocolVector function returns a 
format and associated vector of protocols. In one embodiment, the function performs 
error checking. For example, if a protocol allows only one format to be sent, then the 
format should be the last format in the function call of selectFormatProtocol. The return 
value is a boolean value where true indicates that valid parameters were returned and 
false indicates that no more data is available. The return parameters are int and vector of 
int. The first int refers to the format while the vector of int refers to the vector of 
protocols for the format. When there is no selectFormatProtocol function call, the 
getFormatAndProtocolVector returns the default setting. Also would be evident, other 
collections (e.g., a list template) may be used in place of a vector. 

[p96] The Data Format Processor 575 is responsible for formatting event data into a 

specified format. One exemplary function is the formatEventData function that receives a 
pointer to the abstract class EventData. The return value is a pointer to the abstract class 
FormattedEventData. Generally, interface to the FormattedEventData abstract class is 
defined as in Figure 12C. 

[p97] The Protocol Processor 580 is responsible for outputting the formatted event data 
through the specified protocol. In one embodiment, the processor 580 also encrypts the 
body of message. To output the data, the processFormattedData function is called with an 
input pointer to the abstract class FormattedEventData. The function returns a boolean 
value where "true" represents no errors, and "false" represents the existence of an error 
while processing the formatted data. 

[p98] The System 585 supplies important information and persistent information across 
the execution of the DLL. Some of the important information is timer information 
through the library call. The registry to keep the necessary information is another 
important component of the System 585. Many registry entries are set up at installation 
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toe. An exemplary structure for the registry is: 
m HKEY__LOCAL_MACHTNE -- SOFTWARE -- RicohMonitor -- XXX 
(ApplicationID) 

, ■ ♦• m the following variables are placed in 
r i nm Where XXX represents the Apphcatton ID, the lollowx g 

From FTP Server, FTP User, t ir r<* 

, , 011 P^iSsnowsane^aryc^se.uenceofvariousco.putercooedev.c, 

[Pl011 8 • t"nn The application software sets up the Application ID 

according to the present invention. The appucau 

==========f 

toeorafteranumherofeventsor—gsessionshaveoccurrea). 

lpl021 ^Ma^*^« fc ^ ,, *- ,,ta,( 7 l r 

• w , r fin steo 2) which passes the request to the EventLogg y 
the CMonitorManager (in step wm f 

t ep^TheCMomtotManagerc— ssuhseo.uen.co—, one^eenthe 
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getEventData request made by the CMonitorManager. In step 5, CMonitorManager 
obtains a format and associated vector of protocols from 
CformatAndProtocolInformationBase. Later, step 6, entitled 

"CreateDataFormatProcessor," creates the data formatter for the selected formatting that 
is used to format the monitored event data in step 7. Step 8 obtains the protocol 
processor specified by the application software before stopping monitoring. Together, 
steps 6 and 8 show that the formatters and protocol processors can be created 
dynamically (i.e., only when they are needed). In addition, created protocol processors 
can be cached in the CProcessorBuilder. 

[pl03] Figure 15 shows the map data structure used for creating the DataFormat 

Processor. A map includes at least one (key, value) pair. By using a key (corresponding 
to one of the possible data formats) as an index value into the map, the system selects a 
corresponding pointer to a function that creates the data formatter that will transform the 
monitored event data into the specified data format. When the specified format is sent to 
the ProcessorBuilder in Figure 14, the corresponding value in the map for the format is 
the function pointer to create the formatter. The function pointed by the pointer is to 
create the requested data formatter. Therefore, the formatter itself is not actually created 
until the function pointed to by the pointer is executed. In addition, the class returned by 
this function is the abstract class entitled "data formatter." Accordingly, the user of the 

class does not need to know the details of the returned formatter, just the abstract class 

that defines its basic functions. 
[pl04] Figures 16A and 16B are exemplary code embodiments corresponding to the 

Figure 14. Step 4 in the source code correspond to getting the specified formatter (step 6 

of the Figure 14) while step 5 of the source code formats the data (step 7 of the Figure 

14). 
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While the above discussion has generally focused on using a single protocol and/or 
a single data format, in an alternate embodiment, the present invention utilizes plural 
protocols and/or plural data formats. Those protocols and formats can include, but are 
not limited to any of the protocols and formats discussed herein. Exemplary formats 
include, but are not limited to, uncompressed or compressed versions of any one of: un- 
delimited text, SGML, XML, HTML, csv format, and binary. This enhances the number 
of possible ways that data can be transferred to support the monitoring of the present 
invention. Accordingly, one implementation of the application sends at least one 
(format, protocol) pair to be used by the computer code device (e.g., DLL). The 
computer code device checks that each pair is valid before storing it in the data structure 
of two maps. For example, if the format specifies the binary encoding of fixed format, 
but the protocol is SMTP with the plain text encoding in the mail body, the format and 
protocol are not a valid pair/combination. Before the monitored data are sent out, the 
computer code device checks if a selected protocol is restricted to support only one 
format. Two maps are used for this purpose. Then, the system utilizes the specified data 
format one at a time to generate the required format and sends out the generated data 
over all the protocol specified for this data format. 

16] The present invention is also applicable to implementations where two different 
kinds of parameters are specified multiple times where the first parameter processing is 
more costly than the second parameter processing. In addition, the some second 
parameter values may be restricted to supporting only one first parameter value that is 
specified last. In such a case, the present invention technique can be utilized to process 
the system efficiently. 
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isForroatProtoco,^^ 

w „ different maps specified in the Figure 23 A. 

« — — 1 esy „ g er 56 0sendsa 
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^atAndProtc^Vector reo,ues, to *e CFo ^ ^ 

te recues. to a .e.Forma.Pro.ocoiVec.orMapAfte^ng 
^issen.ontotheCPro.ocolR estrictionCheck class 620. 

L m p Ut ercoded CT ice ( ano bj ee.o t CMoni t orMana e erc 1 ass,T W on 1 ap 

„■ .• rheck class The class also contains the object, 
CFormatProtocolCombmanonCheck class.! 

• , rheck of CProtocolRestrictionCheck class. The flag, 
m _Protoco.Resmct,o n CheckofCPr iotocolRestricti „„Check when 

m JormaffrotocolVectorMapLerator, >s used by the ge,F 
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ft.nc.ion ,0 i,era.e over .he ^Fo.na.Pro.oco.Vec.o.Map. Figure 23B shows the steps 
for uuee main ^notions in the CFormatProtocoUnformationBase class 600. 

r„l 14) Figures 24A and 24B show (he class def.ni.ion of 

CForma.Pro.ocoiCombina.ionCheclc class 6,0. The main responsibiltty of the class 6.0 
is .o check whether a specified forma, and protocol combination is valid. The map, 
m _Combi»a.ionMartix, contains the information of ,he valid combination .ha. ,s 
initialized by the function initMatrix. 

[p, , 5] Figures 25A, 25B, and 25C show the class definition of the 

CProtocolResttictionCheck class 620. The m_bOneForma.Res.ric.ion attribute specf.es 
W he.„er .he —ion is restricted to a single format. Other types of res.ric.ions cou,d 
be implen.en.ed by. adding other private functions and attribute, An exemplary 
restriction algorithm for the presen. invention is illustrated in Figures 25B and 25C 
(showing the steps in the private function oneFormatRestriction). 
IpU6] Obviously, numerous modifications and varia.ions of me presen. invention are 

possible in ligh. of the above .cachings. B is therefore ,0 be understood that, within the 
scope of the appended claims, .he invention may be practiced „.herwise than as 
specifically described herein. 
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Not Applicable 



$ 
4= 

m 
w 

u 
in 

a 

o 

Ul 

H 
□ 
O 



Page 38 of 78 



